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DIGITAL CAMERA AND LENS SYSTEM AND METHOD 

BACKGROUND OF THE INVENTION 

5 

1 . FIELD OF THE INVENTION 

The system and method of the present invention relates to a computer 
implemented digitally simulated camera and lens system. 

10 2. ART BACKGROUND 

The use of computers to display graphic images has become widespread, 
yi Computers frequently are used to generate and /or display three-dimensional 

si; s 

; : j images, pictures and moving images such as video and movies. Animation 

using the computer is quite common. These images are generated a variety of 
13 15 ways. For instance, an image may be computer generated through software 

I " executing on the computer. At other times real world images are imported 

= iss § 

from another media, such as film or a camera and lens apparatus electrically 
connected to the computer system. Computers also are being used to combine 
=ji real world images and computer generated images. 

20 One example is the use of computer generated images to provide special 

effects in video or motion pictures. Many films utilize computer generated 
characters that appear to walk around, talk and perform actions and appear to 
be part of a photographed real world wherein the environment was 
photographed separately and prior to the placement of the computer generated 

25 effects. In this type of situation, a high degree of accuracy is required to 

replicate the real world environment and replicate the lens characteristics for 
the incorporation of the computer generated effects. Problems can arise when 
combining real world images and computer generated images. 
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In order for the computer generated special effects images to match the 
real world photography, it is necessary to duplicate the lens characteristics and 
the motions of the camera which took the real world photographic images as 
closely as possible. If the camera lens setting is not duplicated accurately, the 
elements of the perspective will be wrong and the computer graphic simulated 
object will not appear to actually reside in the original photographed 
environment. 

When computer graphics generated objects or characters are placed in a 
scene and the lens do not match, the computer graphics generated objects fail to 
appear to be connected to their environment. The result may be large-scale 
motion artifacts such as vibrations or sliding, or the computer graphics element 
may exhibit inconsistencies compared to the original photographed image. For 
instance, characters that walk may appear to move an incorrect distance in 
relation to their size or the size of their steps. Objects such as desks and cars 
which approximate known dimensions will not appear square and their 
perspective and angle will be incorrect; for example, the feet of a computer 
generated person may not stand on the floor. Thus, as a result of the object not 
correctly matching in the three dimensional space, visual disturbances occur to 
the viewer which can compromise the integrity of a computer graphic image. 

Modern photographic camera equipment and lenses contain a number of 
fixed and adjustable elements or parameters that need to be considered when 
providing a proper simulated camera system. The film gate (sometimes 
referred to as the aperture) represents a horizontal and vertical dimension of 
the image being exposed onto the photographic film or, in the case of the video 
camera, the size of the video image recording chip. The f-stop (sometimes also 
referred to as the aperture) on the lens controls the amount of light striking the 
aperture. The focal length of the lens identifies the distance from the rear nodal 
point of the lens to the surface of the focal plane. The focus represents a 
distance in front of the camera. The field of view is the area photographed by 
the lens and contains the images captured through the lens. The circle of 
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confusion provides a measure of image clarity or sharpness of focus for a point. 
A camera typically has a focus ring to control focus from a setting of infinity to 
distances typically in the range of two to three feet. If it is a zoom lens a second 
control exists to manipulate the focal length. 
5 These different features have different scales and units to express their 

measurements. For example, the focal length typically is expressed in 
millimeters, the film gate (aperture) typically is expressed in thousandths of an 
inch, the actual film stock in the aperture typically is referred to in millimeters, 
the f-stop is a logarithmic scale based on light transmission through the lens, 
10 the focus is typically set in feet, or sometimes in inches or meters, and the field 
of view is typically expressed as an angle of degrees either horizontal, vertical 
n or diagonal. In addition, the relationship between the horizontal and vertical 

:R dimensions of the aperture, referred to as the aspect ratio, is represented as a 

M single number assumed to be a ration to a value of 1. Motion picture examples 

m 15 include 1.33:1, 1.66:1, 1.33:1, 1.66:1, 1.85:1, 2.20:1, 2.35:1. Hiese typically are 
H referred to as "1.33", "1.66", "1.85", "2.20", "2.35"; which represents how wide the 

;; ^ format appears to be to the viewer. In addition, the circle of confusion is 

y typically measured in thousandths of an inch. 

m A typical 3D software package does not take into consideration the effect 

" 20 of the lens on a computer generated image. Some 3D software packages, such 
as those marketed by SOFTIMAGE, an Avid Corporation, Inc. company, 
references some of the lens characteristics such as f-stop focus and the circle of 
confusion. However, the lens characteristics used are used strictly in relation to 
the creation of the combined computer graphic image as the final step (i.e., 
25 subsequent to the generation and combination of real world and computer 
generated images) in the simulation process. 

When objects are defined within a computer graphics software 
environment, a camera object is usually specified solely in order to provide a 
particular view of those objects. Since the system is an electronic simulation 
30 and does not use light rays or an optical system to capture and record the 
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image, physical real world issues like focus do not come into play. Instead the 
images are viewed by the user on the computer system or recorded out to a 
picture file. Thus, this computer graphics image is typically sharp to view. 

For these reasons, computer graphics images are normally sharp during 

5 the interactive phase when the images are generated and combined with other 
images, as the images presented to the user during that phase do not take lens 
characteristics into account. Typically an attempt to simulate the effects of 
focus and other lens artifacts are applied as part of a separate and last step, i.e., 
subsequent to the interactive phase, in the creation of a final computer graphic 

10 image. 

In addition, this methodology to simulate lens characteristics tends to be 
n broad and rather imprecise by nature as it is based on a scaled down set of 

J;H criteria and guidelines for lens and lens effects within the program. For 

K i instance, even though some type of depth of field simulation might be 

}fj 15 calculated during the final recording of a computer graphics image, the change 

in focus does not actually change the focal length such as happens with a real 
^ lens. In addition, any settings or effects are typically performed by user 

u J guesswork or trial and error. Thus, artifacts typically occur. 

m In addition, it should be realized that such systems do not provide 

l % 20 adequate feedback of values, determinations of exact boundaries or locations of 

"lis? 

lens effects. 

Furthermore, the calculations typically used to derive the final field of 
view for a particular lens in a 3D package contains assumptions, omissions, 
oversights and oversimplifications of the real world equivalent true lens and 

25 camera combinations. Most notable are the lack of solving for the effects of 
change in focus as it relates to focal length and the lack of equivalent controls 
compared to a real world camera. The relationship among lens attributes, such 
as focal length, focus and f-stop are not well understood or implemented in 
current software packages and do not successfully address the problems and 

30 details of simulating the changes in these optical characteristics. To appreciate 
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this, consider that a 100 mm lens focused at 2 ft. turns into a focal length of 
nearly 120 mm. This is not dealt with by current programs. 

Thus, with respect to focal length, changes to focal length caused by the 
changes of other lens characteristics have been overlooked. Such effects, such as 
5 the changing of focal length as a lens is focused, are obscured to the observer by 
the pronounced effects of blurring as the object goes in and out of focus. In the 
situation where matching a real world environment to a computer-generated 
object is not exact, the situation is oftentimes only fixed through trial and error 
and a user may need to guess tolerances and measurements as an 
10 approximation to regenerate a combined image multiple times to see what 
"looks best". 

n In addition, currently available 3D software packages do not contain 

some of the features common to many real world cameras, such as 

•= J interchangeable reference clips and direct and interactive control of focus, zoom 

gj 15 values and depth of field. These missing elements constitute important 

technical considerations for getting the exact lens setting as close as possible to 
the settings of the real world camera and for being able to operate a computer 

h j graphics virtual 3D camera in the same manner and ease as a real world 

m camera. 

20 The digitally simulated camera and lens system and method of the 

present invention addresses the omissions, oversights and oversimplifications 
incurred in 3D simulation processes and addresses these problems by 
integrating into a computer graphic, virtual, three dimensional camera and lens 
model the variables and features of a real world camera and lens device. 
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SUMMARY OF THE INVENTION 



The system and method of the present invention provides an innovative 
way to simulate true camera and lens devices. In one embodiment, camera and 
lens parameters input are used to generate true camera and lens parameters. In 
an alternate embodiment, if a camera and lens parameter is changed, 
corresponding camera and lens parameters are updated to provide a true 
camera and lens environment. For example, in one embodiment, if the f-stop is 
changed, the near and far focus values are is updated. In an alternate 
embodiment, the system and method of the present invention enables the 
combination of real world and computer generated images without undesirable 
visual artifacts that can occur in prior art systems. Since real world camera and 
lens can be accurately simulated, computer generated images can be generated 
having real world camera and lens characteristics, and a simulated camera and 
lens can be matched to a real world camera and lens device. 



BRIEF DESCRIPTION OF THE DRAWINGS 



The objects, features and advantages of the present invention will be 
apparent from the following detailed description in which: 

Figure la is an overview of one embodiment of the system of the present 
invention. 

Figures lb and lc are simplified block diagrams of a desktop computer 
system and handheld device that operates in accordance with the teachings of 
the present invention. 

Figure 2 is a flow diagram illustrating the input, computations and 
output of one embodiment of the method of the present invention. 

Figures 3a and 3b are simplified flow diagrams illustrating the 
embodiments of processes for adjusting camera and lens parameters in 
response to a camera and lens parameter changes. 

Figures 4a and 4b are simplified flow diagrams illustrating embodiments 
of a process for generating a computer generated image in the field of view of a 
camera modeled according to camera and lens characteristics of a real world 
camera and lens. 

Figure 5 is a simplified flow diagram of a process for determining 
camera and lens characteristics in accordance with the teachings of the present 
invention. 

Figure 6a is a flow diagram illustrating the processes utilized in one 
embodiment of the system and method of the present invention and Figure 6b 
is a table illustrating parameters and variables utilized. 

Figure 7 is a flow diagram that illustrates the infinity cutoff decision 
process in one embodiment of the system and method of the present invention. 

Figure 8a is a perspective view illustrating one embodiment of the 
components of camera and lens system in accordance with the teachings of the 
present invention. 
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Figure 8b is a perspective view illustrating one embodiment of the 
components of the camera and lens system of the present invention. 

Figure 8c is a camera lens point of view showing the different camera 
and lens parameters in one embodiment. 
5 Figure 8d is a top view illustrating the camera and lens parameters in 

one embodiment. 

Figure 9a is one embodiment of a top view illustrating the field of view 
of a camera and lens system in accordance with the teachings of the present 
invention. 

10 Figure 9b is one embodiment of a perspective view of the camera and 

lens parameters illustrated by Figure 9a. 

Figure 9c is one embodiment of a camera view with superposed 3D 
charts and objects in accordance with the teachings of the present invention. 
Figure 9d is one embodiment of a camera view showing a 3D reference 
15 chart and objects without the superposed grid as illustrated in Figure 9c. 

Figure 10a shows a top view of an alternate embodiment of a display of 
camera and lens parameters in accordance with the teachings of the present 
invention. 

Figure 10b provides a perspective view of Figure 10a. 
20 Figure 10c shows a camera view of the camera and lens parameters in 

accordance with the teachings of the present invention. 

Figure 11a shows an alternate embodiment of a display of camera and 
lens parameters in perspective in accordance with the teachings of the present 
invention. 

25 Figure lib shows a top view illustrating the field of view of one 

embodiment of the present invention illustrated b Figure 11a. 

Figure 11c shows a camera view of a 3D reference chart and objects 
corresponding to Figure 11a. 

Figure lid shows the camera view of Figure 11a including 3D reference 
30 chart, objects and a superposed grid. 
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Figure 12a is a top view of an alternate embodiment of a display of 
camera and lens parameters in accordance with the teachings of the system of 
the present invention. 

Figure 12b is a top orthographic view of the parameters illustrated in 
Figure 12a. 

Figure 12c is a camera view of Figure 12a illustrating an object and 
reference chart. 

Figure 13a is a top orthographic view illustrating an alternate 
embodiment of a display of a camera and lens field of view in accordance with 
the teachings of the present invention. 

Figure 13b is a camera view illustrating 3D reference chart and objects of 
Figure 13a in accordance with the teachings of the present invention. 

Figure 14a is a top orthographic view showing the field of view in 
accordance with the teaching of the present invention. 

Figure 14b is a camera view showing a reference chart and objects in 
accordance with the teachings of the present invention. 
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DETAILED DESCRIPTION 

The digitally simulated camera and lens of the present invention, in one 
embodiment, provides numeric and visual feedback of camera and lens 
parameters and automatically updates camera and lens parameters when 
5 changes are made to one or more camera and lens parameters. Thus, the 

operation of the system is not only consistent with the operation of a real world 
or true camera and lens device, but exceeds real world camera operation with a 
precision not typically possible in the real world environment without a great 
amount of manual time consuming effort. The invention provides numeric and 
10 3D feedback of lens characteristics to help the user predict and visualize lens 
characteristics before photography takes place and recreate lens characteristics 

n after images are created. It also provides a visualization and presentation of 

lens data in a new and unique interactive fashion, including characteristics that 
are difficult or impossible to see in real world or typical computer graphics 

(33 15 conditions. 

^ Furthermore, the system of the present invention can determine camera 

5: and lens parameter values in an interactive fashion without requiring overly 

h j burdensome computations. Thus, the system is capable of providing data to 

m the user in one form of a predictive mechanism to define the effects of a real 

* i:j 20 camera and lens before the recording of a real or simulated image or a 

mechanism that recreates a specific setting from a particular camera and lens 
after an image has been captured through normal photographic or electronic 
camera and lens systems. 

Thus, computer generated images can be easily matched to real world 
25 images taken through a camera and lens device without the unsightly artifacts 
that occur when real world and computer generated images are combined 
using prior art systems. In the following description, for purposes of 
explanation, numerous details are set forth in order to provide a thorough 
understanding of the present invention. However, it will be apparent to one 
30 skilled in the art that theses specific details are not required in order to practice 
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the present invention. In other instances, well known electrical structures and 
circuits are shown in block diagram form in order not to obscure the present 
invention unnecessarily. 

An overview of one embodiment of the system of the present invention 
5 is illustrated in Figure la. A processing system 42 receives input either through 
user input 40 or external input 41, such as may come from a camera and lens 
device, and performs certain steps to provide numeric and/or visual feedback 
reflective of the lens and camera parameters of a corresponding digital- 
simulated system and lens that simulates a camera and lens as defined at least 
10 in part by the input. In one embodiment, the steps performed by the processing 
system are determined from instructions stored on media, such as a memory or 
n storage device or received across a transmission media; these instructions are 

executed by processing system 42. 
hi 4 In the present embodiment, the digitally simulated camera software 

m 15 module 44 is interfaced with a three dimensional (3D) software module such as 
one produced by SOFTIMAGE, an Avid Corporation, Inc. company. Specially 

* a developed 3D software that generates 3D images on a display and the 

P 

y corresponding numeric values also may be used. 

m The processing system 42 outputs to an external device 45 and /or 

' !f 20 monitor display 46. In one embodiment, the monitor display 46 is embodied in 
a desktop or notebook computer system, an example of which is illustrated in 
Figure lb, and provides 3D images of different views as seen through the 
digital camera and lens system of the present invention. Alternatively, the 
display may be a simple non-graphical display that provides a numeric 
25 feedback of camera and lens parameters generated in accordance with the 
teachings of the present invention. In the latter embodiment, this may be 
embodied in a simple handheld device, such as a calculator device illustrated in 
Figure lc, which may be used in the field to enable a user to immediately 
determine camera and lens parameter values in view of input parameters and 
30 changes to parameters. 

12 
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Figure 2 is a flow diagram illustrating further the operation of one 
embodiment of the system and method of the present invention. In particular, 
in the present embodiment, the input 50, which may be received from a user or 
from a physical device, may include such parameters as camera orientation 

5 data, lens attributes, film format and inserted reference objects. 

For example, camera orientation input data may include the XYZ 
translational position of the virtual camera in space, as well as the pan, tilt and 
roll attributes of the virtual camera at any particular spatial position. The term 
"pan" relates to the y axis rotation of the camera, producing a horizontal sweep 

10 effect of a scene, a "tilt" relates to an x axis rotation of the camera, producing a 
vertical sweep of a scene, and "roll" relates to a z axis rotation, producing a 
rotational or spinning effect of a scene. 

The camera film format input includes the aperture size and aspect ratio. 
The lens attributes may include the focal length, desired circle of confusion, 

15 focus setting, f-stop and infinity setting cutoff setting. In addition, reference 
objects can be input, such as clips, charts and visual aids, to assist the user in 
performing filming functions. As will be explained below, as parameters are 
input and /or modified, other parameter settings are updated correspondingly 
to provide a realistic and accurate camera and lens system. 

20 To provide this functionality, a number of calculations may be 

performed, such as shown in block 55, including true focal length, true field of 
view and hyper focal distance, depth of field, near focus limit and far focus 
limit, aspect ratio and film gate (aperture) setting. 

Hyper focal distance represents a special case of depth of field in which 

25 objects at infinity, as well as the nearest possible objects, are photographed with 
acceptable sharpness. Therefore, if a lens is focused at the hyper focal distance, 
all the image points between one-half that distance and infinity will not exceed 
a specific circle of confusion. The one-half distance is defined as the hyper focal 
focus. 
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Depth of field represents the range of distances from the camera within 
which objects will be considered acceptable sharp for photographic purposes. 
Depth of field can be specified as a "near focus plane" and a "far focus plane" 
with the actual focus point itself being somewhere in between these two areas. 
Anything between these two planes will be considered "in focus" as defined by 
the circle of confusion setting. 

Correct horizontal and vertical angles of the field of view are determined 
from the true focal length. The system also determines corrected placement of 
reference objects input and correct placement of camera and lens attribute 
markers for display (on a monitor or other device 60). 

Figure 3a is a simplified flow diagram illustrating one embodiment of 
the method of the present invention. At step 305, camera and lens parameters 
are input. In the present embodiment, the parameters that can be input include 
those set forth in Figure 2. The data input can be received from a device such as 
a real world or computer generated virtual camera and lens device, or a media 
device which stores or transmits input data values. A media device includes, 
but is not limited to, memory, data storage device, a computer system, external 
device, a user via a user input device (e.g., through keyboard or cursor control 
device and a graphical user interface), or a wired or wireless network including 
local area network and the Internet. At step 310, if a change of a lens parameter 
is detected, for example, if the focus is changed, then at step 315, other pertinent 
lens parameters are adjusted in response to the lens parameter change. As a 
specific example, in one embodiment, when the focal length is changed all the 
attributes that relate to the focal length are changed. These include the depth of 
field, the hyper focal distance, the hyper focal focus and the angles of field of 
view. In addition, objects used to indicate or locate these effects are also shifted 
accordingly. Alternately, if there is no change in input camera and lens 
parameters, or if an input parameter change does not offset other parameters, 
the process continues and is set to accept new input camera and lens parameter 
data. 
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Another embodiment is illustrated in Figure 3b. At step 320 camera and 
lens parameters are input. True camera and lens parameters are generated, step 
325, based upon the input. Markers or charts can be enabled/ input to the 
system to be viewed by the user, step 330. 
5 These markers include markers defining near focus and far focus or 

other parameters such as the actual position of the hyper focal focus, position of 
the hyper focal distance, position of the focus itself and the position of the near 
and far limits of focus (depth of field). The system of the present invention may 
be configured to output these positions as distances or locations. Other types of 
10 markers and charts follow mechanical or physical versions in the prior art and 
are part of the comprehensive lens and camera simulation of the system of the 
m invention. 

5=0 Thus, if at step 335 a camera and lens parameter is changed, at step 340 

| .\Ji 

Si pertinent camera and lens parameters are updated and at step 345 markers and 

m 15 charts are updated if necessary to provide a consistent view to the user such as 
would be viewed if a physical marker or chart is mechanically attached to a 
camera and lens device, 
jj j In another embodiment, as illustrated in Figure 4a, a virtual camera can 

i]i be modeled, enabling the simulation of a camera and lens system. At step 410, 

'^f 20 the characteristics of a real world camera and lens are input. This input may 
also not be reflective of an actual real world camera and lens device. At step 
415 a model of a digitally simulated model of the camera and lens is generated 
based upon the input camera and lens characteristics. At step 420 a computer 
generated image in the field of view of the modeled camera and lens or data 
25 representative of the same is generated. 

In this embodiment, the system can be used to compute camera and lens 
parameters in the field for correct adjustment of a camera and lens device for 
subsequent use in a computer generated camera and lens system, or to generate 
a true display of an image according to the camera and lens parameters input. 
30 In this situation, the system can be used to predict, visualize or define a 
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situation with the camera and lens before actual photography takes place. 
Thus, the system eliminates guesswork and a search for proper values when 
looking through a viewfinder while providing instantaneous updates as values 
are changed. 

5 In another embodiment, as illustrated in Figure 4b, the invention is used 

after a real world image has been photographed in order to better integrate the 
computer graphics camera with the real world camera, as well as duplicate 
properties of the real world camera and lens. At step 455, a real world image is 
input and at step 460 the lens and camera characteristics that photographed the 
10 real world image are input to the system. At step 465 a digitally simulated 
model of a camera and lens is generated based upon the input lens 
characteristics. At step 470 a computer generated image in the field of view of 
the modeled camera or data representative of the same is generated. In this 
J embodiment, the system allows the computer graphics camera to more closely 

j : h 1 5 conform to the real world camera. 

The system of the present invention also enables the animation of 
parameters that are typically not animatable. On a typical camera and lens 
device, some parameters can be changed on a routine basis, for example, focus, 
while other things cannot be changed because of physical and mechanical 
20 limitations, such as the size of the film or the aperture. Because the system of 
the present invention provides a simulated environment that is not constrained 
by mechanical physical limitations, it allows for the animation of parameters 
that typically are considered unanimatable. 

At first glance, it would appear that such a feature would not provide 
25 any useful ability; however, during an image's life, the image may go through 
many processes, any one of which can cause the aperture or aspect ratio to 
change. The most typical situation would be if the film were scanned or 
digitized for being input to an image based software package. If the pictures 
are altered either through cropping or some other image processing technique, 
30 it would be possible to change the apparent aperture size or aspect ratio of the 
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digitally simulated camera and lens using the system of the present invention. 

If these values are changing throughout the course of a motion picture shot, the 

system would cause an animating change in the apparent aperture and/ or 

aspect ratio of the images. Thus, the system of the present invention provides 
5 the ability to animate these attributes accordingly to compensate for a change in 

aspect ratio or film gate pass necessary to correct artifacts that may result from 

such an unusual situation. 

In addition, based on a portion of the lens parameters input, other lens 

parameters can be generated. This is illustrated in the flowchart of Figure 5. At 
10 step 505, at least a subset of camera and lens parameters desired are input. At 

step 510, the true lens parameters are generated based upon the input. 
n In an alternate embodiment, the user or a device inputs a basic subset of 

parameters, which preferably are correct values, to initialize the process. Once 
K 4 the basic subset is input, the system is able to correct those lens and camera 

gjj 15 values based upon the relationship of the parameters to each other. Thus, for 
fi example, the system may correct a focal length for focus and adjust all 

necessary derived values, such as readjustment of the depth of field based on a 
|J new derived focal length determined from focus calculations. Therefore, based 

m on the input, the system may adjust a parameter even though a value was 

* ; if 20 input. As the camera and lens parameters of a real world device can be 

simulated by the process, the simulated camera and lens system can be matched 

to a physical camera and lens device. 

At steps 520, 525, corrected data is output. In one embodiment, the 

numeric values are output, step 525, to a display, storage device or other output 
25 device or media. Alternately, graphical representations, as will be illustrated 

below in subsequent drawings, are generated, step 520. In an alternate 

embodiment, both numeric values and graphical representations are output, 

steps 525, 520. 

A more detailed flow diagram of the processes utilized in one 
30 embodiment of the present invention is illustrated in Figure 6a. Figure 6b is a 
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table presenting a number of the variables that will be referenced in the 
following discussion. Referring to Figure 6a, the input consists of focus 605, 
focal length 610, aspect ratio and aperture values 615, infinity setting 620, f-stop 
and circle of confusion 625. Utilizing the focus 605, focal length 610, the true 
focal length 630 is determined. The true focal length may subsequently be 
reflected as a number provided to a user holding a field device, such as a 
handheld device, or graphically presented to the user as will be shown below. 
To determine the true focal length, a computation or a look-up table may be 
used, block 635. In one embodiment, the calculation is as follows: 
TFL = FLV(Focus-FL), 

where the TFL represents the true focal length, FL represents the focal length 
input and focus is the Focus value input. 

Using mathematical equations may be sufficient for some simple lenses. 
However, very complex lenses, lenses that are of special design, or even lenses 
that are out of alignment or unstable may require a measurement and mapping 
of basic lens properties from which look-up tables may be generated. This may 
occur, for example, when a particular type of lens and camera combination is 
required or some photography has been already shot with a particular type of 
lens in camera that was not in perfect condition. Furthermore, it is fairly 
common for the markings on a lens to be slightly off. For instance, the marks to 
indicate focus setting on a lens can be off by enough to cause an object to be out 
of focus if one were to only go on the lens markings and not look through the 
viewfinder. Even some lenses that are considered in "perfect" functioning 
condition simply do not operate according to the normal optical equations. 
There are a number of lenses, particularly zoom lenses and those designed for 
microscopic or macroscopic whose design is fundamentally non-linear. In these 
cases, changing lens attributes such as focus or the focal length (on a zoom lens) 
have unpredictable results. Thus, some mechanism needs to exist to adjust the 
recorded values so the values correspond to the true optical properties of the 
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lens. A look-up table provides a mechanism for incorporating those lens 
peculiarities into the invention's calculations to correct for these abnormalities. 

One advantage to the look-up table is that the table can provide for non- 
linear lens characteristics of a particular camera and lens device, thus enabling 
5 the system to better match a particular camera and lens device. The look-up 
table in one embodiment may be empirically determined. For example, a look- 
up table may be configured as follows to include empirically determined 
information: 
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A look-up table may be generated by typically sampling or measuring 
the changes in focus in focal length over a range of settings. Interpolation 
25 between these measured values is performed to produce correct lens values 
between the measured points. These values may then be used to provide a 
more accurate readout of the resulting changes. 

A correct vertical field of view 640 and horizontal field of view 645 are 
determined using the aspect ratio and aperture size 615. In this instance, the 
30 arctangent function is performed using a lookup table of values. 

19 



Thus, in one embodiment, the following computation is performed to 
determine the correct horizontal and vertical field of view. 

Vfov = 2*(atan(Ap/Ar)/2,FL)) 

Hfov = 2*(atan(Ap/2, FL)) 
5 Where Vfov represents the vertical field of view, Hfov represents the horizontal 
field of view, atan represents an arctangent function, Ap represents the aperture 
size, Ar represents the aspect ratio and FL represents the focal length. 

Using the true focal length 630 determined, three dimensional clips or 
charts 650 can be placed a certain distance from the camera and subsequently 
10 can be consistently located regardless of other changes to lens parameters. This 
information is used to provide visual feedback 650 to the user in the form of 
lens parameter values or a graphical display of an image with the three 
dimensional clips and charts superimposed over the image relative to the 
particular field of view determined. 
15 In one embodiment, the clips are positioned according to the following 

equation: 

Clip Pos = (TFL/2.54)/Ar 

Where Clip Pos represents the reference clip position in feet from the camera 
position, TFL represents the true focal length, and Ar represents the film gate 

20 aspect ratio. 

The hyper focal distance 660, is determined from the focus value 605 
input, the circle of confusion 625, and the true focal length 630 determined. In 
one embodiment, the hyper focal distance may be determined according to the 
following: 

25 Hd = (TFL 2 )/(Fs*Coc) 

where Hd represents the hyper focal distance, TFL represents the true focal 
length, Fs represents the f-stop and Coc represents the circle of confusion. 

Using the hyper focal distance 660, the hyper focal focus may be 
determined as: 

30 Hf = Hd x 0.5. 
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The focus 605 and true focal length are also used to determine three 
dimensional markers, such as scale and position 650, with respect to displayed 
image and lens characteristics. The hyper focal distance 660 also is used. In one 
embodiment, the markers are placed in accordance with the following equation: 
Marker Pos = (TFL/2.54)/Ar 

The hyper focal distance 660 is used to determine the hyper focal focus 

670. 

The hyper focal focus 670 is used to determine the depth of field, in 
particular, far focus and near focus. In one embodiment, the far focus and near 
focus is determined as follows: 
Nf = (Hd*Fo) / (Hd+(Fo-TFL)) 
Ff = (Hd*Fo)/(Hd+(Fo+TFL)) 

where Nf represents the near focus, Ff represents the far focus, Fo represents 
focus, Hd represents the hyper focal distance, TFL represents the true focal 
distance. 

A computer graphics environment is not typically bounded by the 
normal constraints of physical real world. Therefore, an object can be of nearly 
any size and any distance from the camera. However, this can bring out 
problems when dealing with objects or calculations that can often go to infinity 
such as the focus characteristics. 

For example, a number of situations arise where a particular focus 
setting and f-stop yield a far focus setting that is essentially set at infinity. This 
causes the far focus marker to shoot off to some astronomical distance from the 
camera in a simulated camera program; this is neither desirable nor does it 
provide any valuable information. In addition, some 3D software programs 
include a feature that automatically shifts the- view or camera so all objects are 
in frame at one time. Thus, if an object is off at infinity, the top view in the 
three dimensional software will also scale back to an astronomical distance in 
order to try and "see" all the objects at once. 
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Unfortunately, if this happens, these view cameras move so far away 
that even large objects turn into small specs on the screen. The resultant effect 
is that valuable information is lost as the view moves back to include the far 
focus marker which is far away. Thus, in one embodiment of the system of the 
5 present invention, the user is able to "set infinity". The setting for infinity 
defines the far bounds of the area interest. The user can work at a reasonable 
scale with a user defined boundary or area while still gaining all the benefits of 
the mathematical calculations and feedback from the markers within that 
bounded area. 

10 This feature is valuable in a variety of situations, but it is particularly 

valuable when dealing with simulations, miniatures and models where the area 
j., of concern is very small. In this case, seeing all the markers requires careful 

y3 setup of side, top and front views of the camera and focus marker positions and 

a'i s 

\J having a setting for infinity helps preserve these views. 

m 15 One embodiment of the process for determining the infinity cutoff is 

illustrated in Figure 7. The infinity setting 710 may be a single number set by 
« the user in order to define the limits of the area of interest from the camera as a 

y base point. Therefore, if the user sets the infinity setting to 10 feet, then all 

jj^ reference objects controlled by the invention will be restricted to movement 

20 within 10 feet of the camera. No markers or other objects controlled by the 
invention will be allowed to go beyond 10 feet in any direction from the 
camera. If the user decides to change the infinity setting to 100 feet, everything 
is recalculated and all markers controlled by the invention will be restricted to a 
placement within 100 feet of the camera. This allows the user to restrict the 
25 invention's markers to a desirable range in order to limit their movement. 

Using the focus (Fo) 705, infinity setting 710, the hyper focal distance 715 
and true focal length 720 an initial far focus (Ff) is determined: 
Ff = (Hd*Fo)/ (Hd-(Fo-TFL)) 

If the far focus exceeds the infinity setting 735, then the far focus is set to 
30 the infinity setting value 740. If the far focus does not exceed the infinity setting 
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and the far focus is less than the hyper focal focus 745, then the final calculated 
far focus value (FinFf)is set to be equal to the far focus value 750. Otherwise, 
the final focus value is set to the infinity setting 755. 

Embodiments and advantages of the present invention will be explained 
using the following figures. In one embodiment of the system of the present 
invention, it is contemplated that the values determined are generated as 
numerical values for a simplified presentation in a field use device, such as a 
small handheld device. In other embodiments, the graphical handheld display 
is generated; sample graphical display images are illustrated in the following 
figures. 

Referring to Figure 8a, a three dimensional perspective view of basic 
camera and lens parameters is illustrated. The current view includes a camera 
body 802, and lens 804. Immediately in front of the lens is a small rectangle 806; 
an arrow 808 points to the center of the rectangle 806. This is a 3D reference 
marker which is viewed by the camera 802. In this embodiment, the 3D 
reference marker includes the numbers "2.35" which indicate that it is a 2.35 
aspect ratio marker. The larger rectangle 810 is the near focus marker which 
identifies one end of an acceptable focus towards the camera. In the one 
embodiment, the letters NF (near focus) are associated with the rectangle both 
horizontally and vertically for easy reference. Beside the letters and on top of 
the near focus marker rectangle, there is an arrow 811 pointing to the actual 
focus point setting 812. The tip of the arrow is exactly at this point of focus. 
Also included is a far focus marker (FF)814. This is similar to the near focus 
marker that defines the other end of acceptable focus towards the camera, and 
also includes an arrow 816 which points to the actual focus point 812. It should 
be noted that although the two arrows 811 and 816 are slightly offset from each 
other, they both point exactly to the same place in space, the actual user set 
point of focus 812. The values for the near focus marker and far focus marker 
are calculated from this point 812. Also illustrated is a hyper focal focus point 
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820. In addition, another arrow 825 points to the location of the hyper focal 
distance 824. 

In one embodiment of the system of the present invention, these markers 
may be instantly updated whenever an associated lens or camera parameter 
changes. For example, the markers will change with corresponding changes in 
f-stop or focus. Thus, the markers will shift towards the camera or away from 

> 

the camera appropriately and can be viewed from a variety of angles, either 
through the camera or from another point of view. 

Figure 8b shows the same scene as Figure 8a, but the camera body has 
been removed and a reference grid 830 has been placed on the floor. For 
purposes of discussion, the grid illustrated in the Figures is included as a visual 
guide to better orient the viewer's perspective, to note the changes in the 
position of the markers as various lens parameters are changed, and to help 
understand the 3D relationship of the camera, lens and marker objects as shown 
in the different views. 

In the embodiment illustrated by Figure 8b, the camera markers are 
attached to the camera and travel with the camera; therefore, no matter what 
direction the camera faces, or where it moves, the markers stay in correct 
orientation to the camera and lens. 

Figure 8c shows the camera point of view for the scene of Figures 8a and 
8b. It should be noted that the aspect ratio or marker (2.35) is centered in the 
lens' field of view, whereas the depth of field is defined by the near focus and 
far focus markers. A top orthographic view can also be generated in the present 
embodiment. This is illustrated in Figure 8d. 

Figures 8a-8d show the same scene from three different view points. In 
this example, the user has set the focal length to 19mm and the focal distance is 
set to four feet with an f-stop of £2.8. Because focus affects focal length, the focal 
length, in accordance with the teachings of the present invention, has been 
recalculated to the true focal length of 19.3008mm. The values for the hyper 
focal distance, hyper focal focus, near focus, far focus and the 3D reference chart 
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position also are calculated to provide the correct relationship among the 
parameters. 

Figure 9a shows a wide scale top view with special reference lines to 
indicate the actual camera field of view 905, 910. The angle of view lines 915 
represents the exact edges of the camera's view. It should be noted that the 3D 
reference chart 920 exactly fits in the angle view at its distance from the lens. 
The chart does not extend beyond the angle of view lines, and does not fall 
short of the angle of view lines. The chart's three dimensional position from the 
camera is calculated to fit exactly in the field of view so that the reference charts 
always stay visually in the same place when viewed through the lens even 
though the lens values are changing. Thus, the chart is moved to compensate 
and maintain an exact steady position relative to the camera field of view such 
as a physical chart would do when physically attached to a camera and lens 
device. 

A one foot by one foot cube 925 is placed in the distance for comparison 
with other camera points of view. In Figure 9c the focal length is very short 
(e.g., a wide angle lens is used). Thus, the cube 925 appears very small. 
Figure 9b is a perspective view of the scene of Figure 9a, showing the 3D 
reference chart 920, the near focus 940 and far focus 945, defining the field of 
view, and the hyper focal distance 950. Figures 9c and 9d provide a camera 
view of the scene of Figure 9a. In particular, Figure 9c shows a 1.5 aspect ratio 
chart wherein the text marker is turned off and the Motion Picture Industry's 
standard 22 field chart (VISTAVISION) is substituted in the place of the 2.35 
chart. Figure 9d shows a 2.35 aspect ratio 3D reference chart 910. 

Thus, it can be seen that the charts are interchangeable and follow the 
same rules of placement and orientation regardless of which chart is chosen. 

Figures 10a through 10c illustrate a scene with the f-stop set to f5.6. 
Comparing Figures 10a -10c to 9a - 9c it can be seen that the focal length has not 
changed and the reference chart position has not changed because the focal 
length has not changed. However, lens parameters based on the f-stop have 
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changed. These include hyper focal distance, hyper focal focus, near focus and 
far focus. For example, by comparing Figures 10c and 9c it can be seen that the 
apparent size of the near focus marker in Figure 9c occupies a much smaller 
part of the camera field of view than it does in Figure 10c. This is because the 
near focus marker has been calculated to be much closer to the camera with a 
much larger f-stop in Figure 10c. Similarly, the far focus marker is further away 
from the camera in Figure 10c compared to Figure 9c. These changes and 
values demonstrate several simultaneous changes in focus parameters as only 
one value has changed, in this case the f-stop. 

Figures 11a through lid illustrate the change in the focus distance. In 
this situation, the parameters are set to the same as shown in Figures 9a 
through 9d, but the focus has been changed from four feet to ten feet. Because 
the focus is changing, the focal length changes accordingly. In this situation, 
focusing further away from the camera results in a focal length that is slightly 
shorter; thus, the calculated true focal length equals 19.1192mm, while at four 
feet it was 19.3008mm. Visually, the difference can be seen by comparing 
Figure 9b with Figure 11a. Figure 9b has a focus of four feet, and Figure 11a 
has a focus of ten feet. 

It should be noted that the hyper focal distance and hyper focal focus 
and the 3D reference marker position have only changed very slightly due to 
the very slight change in focal length from the affected focus. However, the 
positions of the near and far focus have changed dramatically due to the focus 
being set further away from the camera. 

In Figure 11a the perspective view of the camera and lens markers have 
been moved back a significant amount in order to show the far focus marker 
being so far away from the camera. Also, it should be noted that in Figure 11a, 
the arrows coming from the near focus marker and far focus marker still point 
to the same position space as the actual focus setting of ten feet. As noted 
earlier, these marker arrows expand in accordance with the positions of the tails 
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set at the marker positions and the tips of the arrow stay at the user focus 
setpoint. 

The changing angle of view can be seen by comparing Figures 9a and 
lib. The angle of view change is slight; however, by comparing the location of 
5 the angle of view with respect to the grid in the two figures a slight change of 
position can be seen. The change is due to a very slight change of focal length 
between a four foot setting and a ten foot setting on a 19mm lens. These types 
of changes, although very small, are what lead to problems in the prior art 
when attempting to align images when the focal length has not been correctly 

10 calculated to take into the account the effects of focus. 

Figures 12a through 12c show a different camera and lens setup in which 
a 100mm lens is set to a ten foot focus and f-stop of F2.8. Figure 12a is a top 
orthographic view. It can be seen that two arrows point exactly to the ten foot 
line on the grid. It should also be noticed that the 3D reference chart has been 

15 moved up to 2.7861 feet in front of the lens, whereas the position for the 19mm 
lens setup (e.g., Figures 9a through 9d) was a little over a .5 feet. This is 
because the angle of view has become very narrow and to fit the angle of view 
exactly, the 3D reference chart must be pushed out further beyond the lens to 
correctly be represented in the camera field of view. This effect also can be seen 

20 referencing Figures 12b and 12c. In Figure 12b, the 3D reference chart 1250 is 
far beyond the lens 1255. The near and far focus markers (not visible) are 
positioned approximately ten feet beyond the lens. Thus, referring to Figure 
12b it can be seen that the much longer focal length lens results in fixed cube 
1265 becoming much larger in frame (row positioned roughly between the left 

25 "2" and "4" markers on the numbered grid) compared to the cube in Figure lid. 
The cube in Figure lid is the very small square 1122 to the left of the center 
zero mark; this illustrates the effects of the changing focal length. 

Figures 13a and 13b show the effect of changing the focus to twenty feet 
while keeping the other parameters the same. The near focus and far focus 

30 markers are positioned with the tips of the markers located at exactly twenty 
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feet. The depth of view is barely one foot on either side. However, near focus 
and far focus markers appear very large in Figure 13b. They are actually very 
far away as shown in Figure 13a . 

Figures 14a and 14b show the effect of changing the f-stop from f2.8 to 
fl6. By increasing the f-stop to fl6, the near and far focus are expanded much 
further away from each other resulting in a much greater depth of view. The 
arrows of the markers still point to the twenty foot mark which is a user set 
focus setting. As the f-stop is changed by the user, the lens parameters 
automatically are updated and positioned correctly. It should be recognized 
that throughout the examples shown, whenever a reference chart, such as the 
numbered grid, is seen through the camera, it usually appears absolutely the 
same regardless of the focal length or other changes, as if there were a fixed 
object attached to the camera eye piece aperture, just like a physical chart that is 
mechanically attached to a real world camera. As discussed above, the effect is 
achieved by calculating dynamically the reference chart position in order to 
reverse the effects of the changing focal length. Thus, the reference chart 
appears unchanging to the user and camera point of view while it is actually 
changing its position in the 3D world to simulate the static effect. Visually this 
effect is illustrated by comparing Figure 12c and 9c. Although the near focus 
and far focus and other markers are moving, the reference clip does not appear 
to change position in the camera point of view even though its position is 
drastically different. 

The invention has been described in conjunction with the preferred 
embodiment. It is evident that numerous alternatives, modifications, variations 
and uses will be apparent to those skilled in the art in light of the foregoing 
description 
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CLAIMS 

What is claimed is: 

1 LA method for modeling a digitally simulated camera and lens 

2 comprising adjusting at least one camera and lens parameter of a plurality of 

3 camera and lens parameters in response to the adjustment of at least one other 

4 camera and lens parameter. 

1 2. The method as set forth in claim 1, wherein the plurality of 

2 camera and lens parameters are selected from the group comprising field of 

3 view, lens focus, focal length, depth of field, hyper focal focus, camera aperture 

4 and aspect ratio. 

j : jj 1 3. The method as set forth in claim 1, wherein the at least one other 

^ 2 camera and lens parameter is selected from the group comprising an aspect 

B3 3 ratio and aperture and the at least one camera and lens parameter is selected 

Lj 4 from the group comprising hyper focal distance, hyper focal focus, near focus 

5 and far focus. 

V) 5 

ffl 1 4. The method as set forth in claim 1, wherein the at least one other 

^ 2 camera and lens parameter comprises focal length and the at least one camera 

3 and lens parameter is selected from the group comprising hyper focal distance, 

4 hyper focal focus, depth of field and field of view. 

1 5. The method as set forth in claim 1, wherein the at least one other 

2 camera and lens parameter comprises focus and the at least one camera and 

3 lens parameter is selected from the group comprising focal length, near focus, 

4 far focus and field of view. 

1 6. The method as set forth in claim 1, further comprising generating 
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2 a digital output representative of at least one camera and lens parameter of the 

3 plurality of camera and lens parameters. 

1 7. The method as set forth in claim 1, further comprising generating 

2 a graphical display of a scene in accordance with a modeled camera and lens 

3 using the plurality of camera and lens parameters, wherein the display is 

4 updated as camera and lens parameters are adjusted. 

1 8. A method for modeling a digitally simulated camera and lens 

2 comprising: 

3 receiving at least one initial camera and lens parameters of a plurality of 

4 camera and lens parameters; and 

5 generating at least one other camera and lens parameter of the plurality 

6 of camera and lens parameters using the at least one initial camera and lens 

7 parameter. 

1 9. The method as set forth in claim 8, wherein the at least one initial 

2 camera and lens parameter is selected from the group comprising focal length, 

3 aperture and lens size and the at least one other camera and lens parameter 

4 comprising a field of view. 

1 10. The method as set forth in claim 8, wherein the at least one initial 

2 camera and lens parameter comprises camera and lens parameters reflective of 

3 a real world camera and lens parameter and the step of generating generates 

4 camera and lens parameters to match the real world camera and lens. 

1 11. The method as set forth in claim 8, wherein the plurality of 

2 camera and lens parameters are selected from the group comprising field of 

3 view, lens focus, focal length, depth of field, hyper focal focus, camera aperture 

4 and aspect ratio. 
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1 12. The method as set forth in 8, further comprising generating a 

2 digital output representative of at least one camera and lens parameter of the 

3 plurality of camera and lens parameters. 

1 13. The method as set forth in claim 8, further comprising generating 

2 a graphical display of a scene in accordance with a digitally modeled camera 

3 and lens using the plurality of camera and lens parameters. 

1 14. A method for modeling a digitally simulated camera and lens 

2 comprising: 

3 receiving at least one initial camera and lens parameter of a plurality of 

4 camera and lens parameters; 

5 receiving at least one other camera and lens parameter of the plurality of 

6 camera and lens parameters; and 

7 selectively correcting the at least one other camera and lens parameter in 

8 view of the at least one initial camera and lens parameter. 

1 15. The method as set forth in claim 14, wherein the plurality of 

2 camera and lens parameters are selected from the group comprising field of 

3 view, lens focus, focal length, depth of field, hyper focal focus, camera aperture 

4 and aspect ratio. 

1 16. The method as set forth in claim 14, further comprising generating 

2 camera and lens parameters based upon camera and lens parameters selected 

3 from the group comprising the at least one initial camera and lens parameter 

4 and the at least one other camera and lens parameter. 

1 17. The method as set forth in claim 14, further comprising generating 

2 a digital output representative of at least one camera and lens parameter of the 
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3 plurality of camera and lens parameters. 



1 18. The method as set forth in claim 14, further comprising generating 

2 a graphical display of a scene in accordance with a modeled camera and lens 

3 using the plurality of camera and lens parameters. 

1 19. A method for digitally simulating a digital camera and lens on a 

2 computing system comprising the steps of: 

3 receiving input representative of at least one camera and lens parameter; 

4 processing the input to produce calculated camera and lens parameters; 

5 and 

6 outputting the calculated camera and lens parameters. 



1 20. The method as set forth in claim 19, wherein the calculated 

2 camera and lens parameters comprise parameters not included in the input. 

1 21. The method as set forth in claim 19, wherein the calculated 

2 camera and lens parameters comprise corrected lens parameters determined 

3 from the input. 

1 20. The method as set forth in claim 19, wherein said receiving step 

2 comprises receiving input from an external camera and lens device. 

1 22. The method as set forth in claim 19, wherein said receiving step 

2 comprises the step of receiving input values from a user operated device. 

1 23. The method as set forth in claim 19, wherein the input comprises 

2 focal length and focus and the calculated camera and lens parameters comprise 

3 a true focal length that is determined as a function of the input focal length and 

4 focus. 
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1 24. The method as set forth in claim 19, wherein the input comprises 

2 an input focal length and infinity focal length cut off and the calculated camera 

3 and lens parameters comprise a focal length that is determined as a function of 

4 the input focal length and infinity focal length cut off. 

1 25. The method as set forth in claim 19, wherein the input comprises 

2 an aspect ratio and aperture and the calculated camera and lens parameters are 

3 selected from the group comprising hyper focal focus, hyper focal distance, 

4 near focus and far focus, the calculated camera and lens parameters determined 

5 as a function of the aspect ratio and aperture. 



; 0 1 26. The method as set forth in claim 19, wherein the input comprises a 

• 4 2 desired circle of confusion and the calculated camera and lens parameters 

3 comprise a focus that is determined as a function of the desired circle of 

4 confusion. 

s.. J. 

y 1 27. The method as set forth in claim 19, further comprising the steps 

U 2 of: 

3 receiving reference objects; 

4 inserting the reference objects in a field of view; and 

5 updating the reference objects to be consistently in the field of view 

6 when changes to camera and lens parameters are effected. 

1 28. The method as set forth in claim 19, wherein said input comprises 

2 camera orientation data relative to a subject being viewed by the camera and 

3 lens, said processing step comprising the step of calculating the camera and 

4 lens parameters as a function of the camera orientation data. 

1 29. The method as set forth in claim 19, wherein the step of 
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2 processing comprises referencing a table of camera and lens parameters to 

3 determine calculated camera and lens parameters. 

1 30. The method as set forth in claim 19, wherein the step of 

2 outputting comprises outputting graphical representations of at least a portion 

3 of the camera and lens parameters to a graphical display. 

1 31. The method as set forth in claim 19, wherein the step of 

2 outputting comprises outputting numerical values representing at least a 

3 portion of the camera and lens parameters. 

1 32. The method as set forth in claim 30, wherein said graphical 

2 representations show a point of view of a scene from a position not in a field of 

3 view defined by the camera and lens. 

1 33. The method as set forth in claim 19, wherein the step of 

2 outputting comprises outputting numeric values representative of the camera 

3 and lens parameters to a real world camera and lens device. 

1 34. A method for simulating a digital camera and lens on a computer 

2 generated display, said method comprising the steps of: 

3 generating markers indicative of the optical characteristics of the camera 

4 and lens; and 

5 generating on the display an image reflective of objects viewed through 

6 the camera and lens; and 

7 generating on the display the markers relative to the image viewed 

8 through the camera and lens. 

1 35. The method as set forth in claim 34, wherein the markers 

2 comprise markers representative of a hyper focal distance. 
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1 36. The method as set forth in claim 34, wherein the markers 

2 comprise markers representative of the hyper focal focus of the lens. 

1 37. The method as set forth in claim 34, wherein the markers 

2 comprise markers representative of near and far limits of focus of the lens. 

1 38. The method as set forth in claim 34, wherein the markers are 

2 adjustable by a user. 

1 39. The method as set forth in claim 34, further comprising a user 



2 inputting an adjustment to at least one marker using a user input device, the 

3 marker adjusted based on the user input. 

1 40. The method as set forth in claim 39, wherein said step of said user 

2 inputting comprises said user moving a cursor using a cursor control device to 

3 move the at least one marker on the display. 

4 41. The method as set forth in claim 39, wherein said step of said user 

5 inputting comprises the step of said user inputting a value that indicates that 

6 the at least one marker is to be moved on the display. 

1 42. A method for simulating a digital camera and lens on a computer 

2 generated display, said method comprising the steps of: 

3 generating reference charts to be used by the user; 

4 generating on the display an image reflective of objects viewed through 

5 the lens; and 

6 generating on the display the reference charts relative to the image 

7 viewed through the lens. 



-35- 



1 43. The method as set forth in claim 42, further comprising the step of 

2 adjusting the size and placement of the reference charts in conjunction with a 

3 change of focal length such that a visible representation of the chart on the 

4 display remains constant to the user. 

1 44. A method for digitally modeling a digital camera and lens 

2 comprising the steps of: 

3 setting a determined infinity distance from the camera lens to a 

4 predetermined value less than infinity; and 

5 adjusting camera and lens parameters such that the determined infinity 

6 distance is not exceeded. 

iij 1 45. The method as set forth in claim 44, wherein the step of adjusting 

m 2 adjusts far limits of focus not to exceed the determined infinity distance. 

y 1 46. The method as set forth in claim 44, wherein the determined 

j! «f 2 infinity distance defines a photographic area of interest. 

m 1 47. A method for matching a first image taken by a first camera and 

;^ 2 lens and a second image generated on a computer system, said method 

3 comprising the steps of: 

4 inputting a digital representation of the first image into the computer 

5 system; 

6 inputting camera and lens characteristics of the first camera and lens; 

7 generating a digital model of the first camera and lens on the computer 

8 system using the camera and lens characteristics input; and 

9 generating the second image in the field of view of the modeled camera 
10 and lens. 

1 48. The method as set forth in claim 47, wherein the camera and lens 
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characteristics are selected from the group comprising field of view, lens focus, 
focal length, depth of field, hyper focal focus, camera aperture and aspect ratio. 

49. The method as set forth in claim 47, wherein the first image input 
is generated by a real world camera and lens. 

50. A hand held camera and lens calculation device comprising a 
processor configured to receive at least one camera and lens parameter of a 
plurality of camera and lens parameters and calculate at least one other camera 
and lens parameter of the plurality of camera and lens parameters. 

51. The hand held camera and lens calculation device as set forth in 
claim 50, further comprising an output display for displaying values 
representative of at least a portion of the camera and lens parameters. 

52. The hand held camera and lens calculation device as set forth in 
claim 50, further comprising a graphic output display for graphically displaying 
images representative of at least a portion of the camera and lens parameters. 

53. The hand held camera and lens calculation device as set forth in 
claim 50, further comprising a user input device configured to receive user 
input of camera and lens parameters. 

54. The hand held camera and lens calculation device as set forth in 
claim 50, further comprising an input port configured to receive input of 
camera and lens parameters from a coupled camera and lens device. 



55. The hand held camera and lens calculation device as set forth in 
claim 50, wherein the camera and lens parameters are selected from the group 
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3 comprising field of view, lens focus, focal length, depth of field, hyper focal 

4 focus, camera aperture and aspect ratio. 



1 56. The hand held camera and lens calculation device as set forth in 

2 claim 50, wherein the calculation comprises an adjustment of the at least one 

3 other camera and lens parameter in response to a change of the received camera 

4 and lens parameter. 

1 57. The hand held camera and lens calculation device as set forth in 

2 claim 50, wherein the calculation comprises a generation of the at least one 

3 other camera and lens parameter using the received camera and lens parameter. 

O i 58, The hand held camera and lens calculation device as set forth in 

rlj 2 claim 50, wherein the calculation comprises and correction of the at least one 

m 3 other camera and lens parameter in view of the received camera and lens 

4 parameter. 

j«l 1 59. A computer system comprising: 

J;H 2 an input; 

ill 3 a display; 

j3 4 a processor coupled to the input and display and configured to receive 



5 from the input at least one camera and lens parameter of a plurality of camera 

6 and lens parameters, calculate at least one other camera and lens parameter of 

7 the plurality of camera and lens parameters and display camera and lens 

8 parameters on the display. 



1 60. The computer system as set forth in claim 59, wherein said 

2 processor is configured to generate a graphical representation of camera and 

3 lens parameters on the display. 

1 61. The computer system as set forth in claim 59, wherein said 
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2 processor is configured to generate a numeric representation of camera and lens 

3 parameters on the display. 

1 62. The computer system as set forth in claim 59, wherein the input 

2 comprises a port configured to be coupled to an external camera and lens 

3 device. 

1 63. The computer system as set forth in claim 59, wherein the input 

2 comprises a port configured to be coupled to a user input device. 

1 64. A computer readable medium comprising instructions, which 

2 when executed by a processing system, modeling a digitally simulated camera 

3 and lens comprising adjusting at least one camera and lens parameter of a 

4 plurality of camera and lens parameters in response to the adjustment of at least 

5 one other camera and lens parameter. 



1 65. The computer readable medium as set forth in claim 64, wherein 

2 the plurality of camera and lens parameters are selected from the group 

3 comprising field of view, lens focus, focal length, depth of field, hyper focal 

4 focus, camera aperture and aspect ratio. 

1 66. The computer readable medium as set forth in claim 64, further 

2 comprising instructions which when executed generate a digital output 

3 representative of at least one camera and lens parameter of the plurality of 

4 camera and lens parameters. 

1 67. The computer readable medium as set forth in claim 64, further 

2 comprising instructions which when executed, generate a graphical display of 

3 a scene in accordance with a modeled camera and lens using the plurality of 

4 camera and lens parameters, wherein the display is updated as camera and lens 

5 parameters are adjusted. 
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1 68. A computer readable medium comprising instructions, which 

2 when executed by a processing system, model a digitally simulated camera and 

3 lens comprising: 

4 receiving at least one initial camera and lens parameters of a plurality of 

5 camera and lens parameters; and 

6 generating at least one other camera and lens parameter of the plurality 

7 of camera and lens parameters using the at least one initial camera and lens 

8 parameter. 

1 69. The computer readable medium as set forth in claim 68, wherein 



2 the at least one initial camera and lens parameter comprises camera and lens 

3 parameters reflective of a real world camera and lens parameter and the step of 

4 generating generates camera and lens parameters to match the real world 

5 camera and lens. 



1 70. The computer readable medium as set forth in claim 68, wherein 

2 the plurality of camera and lens parameters are selected from the group 

3 comprising field of view, lens focus, focal length, depth of field, hyper focal 

4 focus, camera aperture and aspect ratio. 

1 71 . The computer readable medium as set forth in 68, further 

2 comprising instructions which when executed generate a digital output 

3 representative of at least one camera and lens parameter of the plurality of 

4 camera and lens parameters. 

1 72. The computer readable medium as set forth in claim 68, further 

2 comprising instructions which when executed generate a graphical display of a 

3 scene in accordance with a digitally modeled camera and lens using the 

4 plurality of camera and lens parameters. 
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1 73. A computer readable medium comprising instructions, which 

2 when executed by a processing system, model a digitally simulated camera and 

3 lens comprising: 

4 receiving at least one initial camera and lens parameter of a plurality of 

5 camera and lens parameters; 

6 receiving at least one other camera and lens parameter of the plurality of 

7 camera and lens parameters; and 

8 selectively correcting the at least one other camera and lens parameter in 

9 view of the at least one initial camera and lens parameter. 

1 74. The computer readable medium as set forth in claim 73, wherein 

2 the plurality of camera and lens parameters are selected from the group 

3 comprising field of view, lens focus, focal length, depth of field, hyper focal 

4 focus, camera aperture and aspect ratio. 

1 75. The computer readable medium as set forth in claim 73, further 

2 comprising instructions which when executed generate camera and lens 

3 parameters based upon camera and lens parameters selected from the group 

4 comprising the at least one initial camera and lens parameter and the at least 

5 one other camera and lens parameter. 



1 76. The computer readable medium as set forth in claim 73, further 

2 comprising instructions which when executed generate a digital output 

3 representative of at least one camera and lens parameter of the plurality of 

4 camera and lens parameters. 

1 77. The computer readable medium as set forth in claim 73, generate 

2 a graphical display of a scene in accordance with a modeled camera and lens 

3 using the plurality of camera and lens parameters. 
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1 78. A computer readable medium comprising instructions, which 

2 when executed by a processing system, simulates a digital camera and lens on a 

3 computing system comprising: 

4 receiving input representative of at least one camera and lens parameter; 

5 processing the input to produce calculated camera and lens parameters; 

6 and 

7 outputting the calculated camera and lens parameters. 

1 79. The computer readable medium as set forth in claim 78, wherein 

2 the calculated camera and lens parameters comprise corrected lens parameters 

3 determined from the input. 



1 80. The computer readable medium as set forth in claim 78, wherein 



"••4 

2 the input comprises an aspect ratio and aperture and the calculated camera and 

3 lens parameters are selected from the group comprising hyper focal focus, 

4 hyper focal distance, near focus and far focus, the calculated camera and lens 

5 parameters determined as a function of the aspect ratio and aperture. 



1 81. The computer readable medium as set forth in claim 78, wherein 

2 the input comprises a desired circle of confusion and the calculated camera and 

3 lens parameters are selected from the group comprising near focus and far 

4 focus, said calculated camera and lens parameters determined as a function of 

5 the desired circle of confusion. 

1 82. The computer readable medium as set forth in claim 78, further 

2 comprising instructions which when executed, 

3 receive reference objects, 

4 insert the reference objects in a field of view, and 

5 update the reference objects to be consistently in the field of view when 
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6 changes to camera and lens parameters are effected. 

1 83. The computer readable medium as set forth in claim 78, wherein 

2 said input comprises camera orientation data, said processing comprising 

3 calculating the camera and lens parameters as a function of the camera 

4 orientation data. 

1 84. The computer readable medium as set forth in claim 78, wherein 

2 outputting comprises outputting graphical representations of at least a portion 

3 of the camera and lens parameters to a graphical display. 

1 85. The computer readable medium as set forth in claim 78, wherein 

2 outputting comprises outputting numerical values representing at least a 

3 portion of the camera and lens parameters. 

1 86. The computer readable medium as set forth in claim 84, wherein 

2 said graphical representations show a point of view of a scene from a position 

3 not in a field of view defined by the camera and lens. 
1 

2 87. A computer readable medium comprising instructions, which 

3 when executed by a processing system, simulate a digital camera and lens on a 

4 computer generated display comprising: 

5 generating markers indicative of the optical characteristics of the camera 

6 and lens; and 

7 generating on the display an image reflective of objects viewed through 

8 the camera and lens; and 

9 generating on the display the markers relative to the image viewed 
10 through the camera and lens. 

11 

1 88. A computer readable medium comprising instructions, which 
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2 when executed by a processing system, simulate a digital camera and lens on a 

3 computer generated display, comprising: 

4 generating reference charts to be used by the user; 

5 generating on the display an image reflective of objects viewed through 

6 the lens; and 

7 generating on the display the reference charts relative to the image 

8 viewed through the lens. 

1 89. The computer readable medium as set forth in claim 88, further 

2 comprising instructions which when executed adjust the size and placement of 

3 the reference charts in conjunction with a change of focal length such that a 

4 visible representation of the chart on the display remains constant to the user. 

J 1 90. A computer readable medium comprising instructions, which 

"5 

jj 2 when executed by a processing system, digitally model a digital camera and 

3 3 lens comprising: 

4 setting a determined infinity distance from the camera lens to a 

] 5 predetermined value less than infinity; and 

* 6 adjusting camera and lens parameters such that the determined infinity 

J 7 distance is not exceeded. 

1 91. The computer readable medium as set forth in claim 90, wherein 

2 adjusting adjusts far limits of focus not to exceed the determined infinity 

3 distance. 

1 92. The computer readable medium as set forth in claim 90, wherein 

2 the determined infinity distance defines a photographic area of interest. 

1 93. A computer readable medium comprising instructions, which 

2 when executed by a processing system, match a first image taken by a first 
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3 camera and lens and a second image generated on a computer system, 

4 comprising: 

5 inputting a digital representation of the first image into the computer 

6 system; 

7 inputting camera and lens characteristics of the first camera and lens; 

8 generating a digital model of the first camera and lens on the computer 

9 system using the camera and lens characteristics input; and 

10 generating the second image in the field of view of the modeled camera 

1 1 and lens. 

1 94. The computer readable medium as set forth in claim 93, wherein 

2 the camera and lens characteristics are selected from the group comprising 

3 field of view, lens focus, focal length, depth of field, hyper focal focus, camera 

4 aperture and aspect ratio. 

1 95. The computer readable medium as set forth in claim 94, wherein 

2 the first image input is generated by a real world camera and lens. 
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ABSTRACT 



A digitally simulated camera and lens system and method which 
generates true camera and lens parameters based upon input parameters. In 
one embodiment, parameters are generated based upon limited parameters 
input. In an alternate embodiment, parameters are updated to true values 
when corresponding parameters are changed. The camera and lens parameters 
may be output to a variety of media or devices including a three dimensional 
display which displays graphical representations of the parameters and 
associated images. 
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Attorney's Docket No.: 80398.P163 PATENT 
DECLARATION AND POWER OF ATTORNEY FOR PATENT APPLICATION 



As a below named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below, next to my name, 

I believe I am the original, first, and sole inventor (if only one name is listed below) or an original, 
first, and joint inventor (if plural names are listed below) of the subject matter which is claimed and 
for which a patent is sought on the invention entitled 

DIGITAL CAMERA AND LENS SYSTEM AND METHOD 

the specification of which 

xx is attached hereto. 

was filed on as 

United States Application Number 

or PCT International Application Number 

and was amended on . 

(if applicable) 

I hereby state that I have reviewed and understand the contents of the above-identified 
specification, including the claim(s), as amended by any amendment referred to above. 

I acknowledge the duty to disclose all information known to me to be material to patentability as 
defined in Title 37, Code of Federal Regulations, Section 1 .56. 

I hereby claim foreign priority benefits under Title 35, United States Code, Section 1 1 9(a)-(d), of any 
foreign application (s) for patent or inventor's certificate listed below and have also identified below 
any foreign application for patent or inventor's certificate having a filing date before that of the 
application on which priority is claimed: 

Priority 

Prior Foreign Application(s) Claimed 



(Number) 


(Country) 


(Day/Month/Year Filed) 


Yes 


No 


(Number) 


(Country) 


(Day/Month/Year Filed) 


Yes 


No 


(Number) 


(Country) 


(Day/Month/Year Filed) 


Yes 


No 
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I hereby claim the benefit under title 35, United States Code, Section 1 19(e) of any United States 
provisional application(s) listed below 



(Application Number) Filing Date 



(Application Number) Filing Date 

I hereby claim the benefit under Title 35, United States Code, Section 120 of any United States 
application(s) listed below and, insofar as the subject matter of each of the claims of this application 
is not disclosed in the prior United States application in the manner provided by the first paragraph 
of Title 35, United States Code, Section 1 12, 1 acknowledge the duty to disclose all information 
known to me to be material to patentability as defined in Title 37, Code of Federal Regulations, 
Section 1 .56 which became available between the filing date of the prior application and the national 
or PCT international filing date of this application: 



(Application Number) Filing Date (Status - patented, 

pending, abandoned) 



(Application Number) Filing Date (Status - patented, 

pending, abandoned) 

I hereby appoint Farzad E. Amini, Reg. No. P42,261; Aloysius T. C. AuYeung, Reg. No. 35,432; Amy M. 
Armstrong, Reg. No. 42,265; William Thomas Babbitt, Reg. No. 39,591; Carol F. Barry, Reg. No. 41,600; 
Jordan Michael Becker, Reg. No. 39,602; Bradley J. Bereznak, Reg. No. 33,474; Michael A. Bernadicou, 
Reg. No. 35,934; Roger W. Blakely, Jr., Reg. No. 25,831 ; Gregory D. Caldwell, Reg. No. 39,926; Kent M. 
Chen, Reg. No. 39,630; Lawrence M. Cho, Reg. No. 39,942; Yong S. Choi, Reg. No. P43,324; Thomas M. 
Coester, Reg. No. 39,637; Roland B. Cortes, Reg. No. 39,152; Barbara Bokanov Courtney, Reg. No. 
42,442; Michael Anthony DeSanctis, Reg. No. 39,957; Daniel M. De Vos, Reg. No. 37,813; Robert Andrew 
Diehl, Reg. No. 40,992; Tarek N. Fahmi, Reg. No. 41,402; James Y. Go, Reg. No. 40,621; Richard Leon 
Gregory, Jr., Reg. No. 42,607; Dinu Gruia, Reg. No. P42,996; David R. Halvorson, Reg. No. 33,395; 
Thomas A. Hassing, Reg. No. 36,159; Phuong-Quan Hoang, Reg. No. 41,839; Willmore F. Holbrow III, 
Reg. No. P41,845; George W Hoover II, Reg. No. 32,992; Eric S. Hyman, Reg. No. 30,139; Dag H. 
Johansen, Reg. No. 36,172; William W. Kidd, Reg. No. 31,772; Michael J. Mallie, Reg. No. 36,591; Andre 
L. Marais, under 37 C.F.R. § 10.9(b); Paul A. Mendonsa, Reg. No. 42,879; Darren J. Milliken, Reg. 
42,004; Thinh V. Nguyen, Reg. No. 42,034; Kimberley G. Nobles, Reg. No. 38,255; Michael A. Proksch, 
Reg. No. 43,021; Babak Redjaian, Reg. No. 42,096; James H. Salter, Reg. No. 35,668; William W. 
Schaal, Reg. No. 39,018; James C. Scheller, Reg. No. 31,195; Anand Sethuraman, Reg. No. P43,351; 
Charles E. Shemwell, Reg. No. 40,171; Maria McCormack Sobrino, Reg. No. 31,639; Stanley W. Sokoloff, 
Reg. No. 25,128; Allan T. Sponseller, Reg. No. 38,318; Judith A. Szepesi, Reg. No. 39,393; Vincent P. 
Tassinari, Reg. No. 42,179; Edwin H. Taylor, Reg. No. 25,129; George G. C. Tseng, Reg. No. 41,355; 
Lester J. Vincent, Reg. No. 31,460; John Patrick Ward, Reg. No. 40,216; Stephen Warhola, Reg. No. 
43,237; Charles T. J. Weigell, Reg. No. 43,398; Ben J. Yorks, Reg. No. 33,609; and Norman Zafman, 
Reg. No. 26,250; my attorneys, and James A. Henry, Reg. No. 41,064; Daniel E. Ovanezian, Reg. No. 
41,236; Glenn E. Von Tersch, Reg. No. 41,364; and Chad R. Walsh, Reg. No. 43,235; my patent agents, 
of BLAKELY, SOKOLOFF, TAYLOR & ZAFMAN LLP, with offices located at 12400 Wilshire Boulevard, 
7th Floor, Los Angeles, California 90025, telephone (310) 207-3800, and James R. Thein, Reg. No. 
31 ,71 0, my patent attorney; with full power of substitution and revocation, to prosecute this application and 
to transact all business in the Patent and Trademark Office connected herewith. 

Send correspondence to Maria McCormack Sobrino BLAKELY, SOKOLOFF, TAYLOR & 

(Name of Attorney or Agent) 
ZAFMAN LLP, 12400 Wilshire Boulevard 7th Floor, Los Angeles, California 90025 and direct 
telephone calls to Maria McCormack Sobrino (408) 720-8598. 

(Name of Attorney or Agent) 
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I hereby declare that all statements made herein of my own knowledge are true and that all 
statements made on information and belief are believed to be true; and further that these 
statements were made with the knowledge that willful false statements and the like so made are 
punishable by fine or imprisonment, or both, under Section 1001 of Title 18 of the United States 
Code and that such willful false statements may jeopardize the validity of the application or any 
patent issued thereon. 



Full Name of Sole/First Inventor Charles Clavadetscher 



Inventor's Signature Date 



Post Office Address 5146Pickford Wav 



Culver Citv. CA 90232 



Full Name of Second/Joint Inventor 



Full Name of Third/Joint Inventor 



Residence Culver Cit v. Caiifornia Citizenship USA 



(City, State) (Country) 



Inventor's Signature __ Date 

Residence Citizenship 



(City, State) (Country) 
Post Office Address 



Inventor's Signature Date 

Residence Citizenship 



(City, State) (Country) 
Post Office Address 



Full Name of Fourth/Joint Inventor 



Inventor's Signature Date 

Residence Citizenship 

(City, State) (Country) 



Post Office Address 



Full Name of Fifth/Joint Inventor 



Inventor's Signature _ Date 
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Residence 

Post Office Address 



(City, State) 



Citizenship 



(Country) 



Full Name of Sixth/Joint Inventor. 

Inventor's Signature 

Residence ' 



(City, State) 



Post Office Address 



Date 



Citizenship , 



(Country) 



Full Name of Seventh/Joint Inventor . 
Inventor's Signature 



Date 



Residence 



(City, State) 



Post Office Address 



Citizenship 



(Country) 
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Title 37, Code of Federal Regulations, Section 1 .56 
Duty to Disclose Information Material to Patentability 



(a) A patent by its very nature is affected with a public interest. The public interest is best served, 
and the most effective patent examination occurs when, at the time an application is being examined, the 
Office is aware of and evaluates the teachings of all information material to patentability. Each individual 
associated with the filing and prosecution of a patent application has a duty of candor and good faith in 
dealing with the Office, which includes a duty to disclose to the Office all information known to that individual 
to be material to patentability as defined in this section. The duty to disclosure information exists with respect 
to each pending claim until the claim is cancelled or withdrawn from consideration, or the application becomes 
abandoned. Information material to the patentability of a claim that is cancelled or withdrawn from 
consideration need not be submitted if the information is not material to the patentability of any claim 
remaining under consideration in the application. There is no duty to submit information which is not material 
to the patentability of any existing claim. The duty to disclosure all information known to be material to 
patentability is deemed to be satisfied if ail information known to be material to patentability of any claim 
issued in a patent was cited by the Office or submitted to the Office in the manner prescribed by §§1 .97(b)-(d) 
and 1.98. However, no patent will be granted on an application in connection with which fraud on the Office 
was practiced or attempted or the duty of disclosure was violated through bad faith or intentional misconduct. 
The Office encourages applicants to carefully examine: 

(1 ) Prior art cited in search reports of a foreign patent office in a counterpart application, and 

(2) The closest information over which individuals associated with the filing or prosecution of a 
patent application believe any pending claim patentably defines, to make sure that any material information 
contained therein is disclosed to the Office. 

(b) Under this section, information is material to patentability when it is not cumulative to 
information already of record or being made or record in the application, and 

(1) It establishes, by itself or in combination with other information, a prima facie case of 
unpatentability of a claim; or 

(2) It refutes, or is inconsistent with, a position the applicant takes in: 

(i) Opposing an argument of unpatentability relied on by the Office, or 

(ii) Asserting an argument of patentability. 

A prima facie case of unpatentability is established when the information compels a conclusion that a claim is 
unpatentable under the preponderance of evidence, burden-of-proof standard, giving each term in the claim 
its broadest reasonable construction consistent with the specification, and before any consideration is given to 
evidence which may be submitted in an attempt to establish a contrary conclusion of patentability. 

(c) Individuals associated with the filing or prosecution of a patent application within the 
meaning of this section are: 

(1 ) Each inventor named in the application; 

(2) Each attorney or agent who prepares or prosecutes the application; and 

(3) Every other person who is substantively involved in the preparation or prosecution of the 
application and who is associated with the inventor, with the assignee or with anyone to whom there is an 
obligation to assign the application. 

(d) Individuals other than the attorney, agent or inventor may comply with this section by 
disclosing information to the attorney, agent, or inventor. 



Rev. 11/30/98 (D2) 



-5- 



